Temporal Behavior of the Conditional and Gibbs' Entropies 
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We study the temporal approach to equilibrium of the Gibbs' and conditional entropies for both 
invertible deterministic dynamics as well as non-invertible stochastic systems in the presence of 
white noise. The conditional entropy will either remain constant or monotonically increase to its 
maximum of zero. However, the Gibbs' entropy may have a variety of patterns of approach to 
its final value ranging from a monotone increase or decrease to an oscillatory approach. We have 
illustrated all of these behaviors using examples in which both entropy dynamics can be determined 
analytically. 

PACS numbers: 02.50.Ey, 05.20.-y, 05.40.Ca, 05.40.Jc 



CO 



I 

C 

O 

o 



> 

Os 
SO 

as 
o 
in 
o 



-a 
c 

o 
o 



X 



I. INTRODUCTION 

A variety of various measures of dynamic behavior 
carry the name of entropy. Two have proved to be es- 
pecially intriguing in the examination of the temporal 
evolution of dynamical systems when considered from an 
ensemble point of view. 

One of these is known as the conditional entropy. Con- 
vergence properties of the conditional entropy have been 
extensively studied because 'entropy methods' have been 
known for some time to be useful for problems involving 
questions related to convergence of solutions in partial 
differential equations 0, 0, 0, El IS E| • Their utility can 
be traced, in some instances, to the fact that the condi- 
tional entropy may serve as a Liapunov functional 

Another type of entropy is the Gibbs' entropy, which 
is strongly related to an extension of the equilibrium en- 
tropy that was introduced by Gibbs 8] to a time de- 
pendent situation. This has been considered by a num- 
ber of authors recently Ruelle 0, [ljj , Nicolis and Daems 
[rill Daems and Nicolis and Bag et al. pLUij. Bag 

mums. 

Here we compare and contrast the temporal evolu- 
tion of the conditional and Gibbs' entropies in a vari- 
ety of dynamical settings. Our primary considerations 
are stochastic non-invertible systems with additive white 
noise, but we also do discuss the two entropy behaviors 
in systems with invertible dynamics. 

The organization of the paper is as follows. Section [n] 
gives some basic background, definition of steady state 
Gibbs' entropy, and extension of this to time dependent 
situations, and shows how the conditional entropy can be 
considered a generalization of the time dependent Gibbs' 
entropy. Section ITTT1 looks at the behavior of the Gibbs' 
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entropy and the conditional entropy in systems with in- 
vertible dynamics. The general results of this section are 
illustrated with three specific examples. This is extended 
to non-invertible systems in Section llVI where we cite a 
number of results from |Tsj on the behavior of the con- 
ditional entropy and contrast these with the behavior of 
the Gibbs' entropy. These considerations are illustrated 
with two detailed examples drawn from dynamical sys- 
tems perturbed by noise. The paper concludes with a 
summary and discussion in SectionEJwhere we show how 
our results illuminate the connection between a previ- 
ously postulated dynamic analog of the non-equilibrium 
thermodynamic entropy and the entropy increase of the 
second law of thermodynamics. 



II. GIBBS' AND CONDITIONAL ENTROPIES 

Let X be a phase space and /j, a reference measure on 
X. Denote the corresponding set of densities by T>(X), 
or T> when there will be no ambiguity, so / € T> means 
/ > and J x f(x) dx = 1 (for integrals with respect 
to the reference measure we use the notation J f(x) dx 
rather than J f{x)d^(x)). Let {P'}t>o be a semigroup of 
Markov operators on L 1 (X), i.e. P*/o > for an initial 
density / > 0, / P*/o(x) dx = J fo{x) dx, and P t+S f = 
P t (P s fo). If the group property holds for t, s G R, then 
we say that P* is invertible. If it holds only for t, s e R + 
we say that P l is non-invertible. If there is a density /* 
such that P'/* — /* f° r all f > 0, /* is called a stationary 
density of P*. 

In his seminal work Gibbs 0, assuming the existence 
of a system steady state density /* on the phase space X, 
introduced the concept of the index of probability given 
by log/*(a;) where "log" denotes the natural logarithm. 
He then identified the entropy in a steady state situation 
with the average of the index of probability 

P G (./*) = - / f*(x)logf*(x)dx, (2.1) 
Jx 
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and we call this the equilibrium or steady state Gibbs ' 
entropy. 

If entropy is to be an extensive quantity (in accord with 
experimental evidence) then Definition 12.11 is unique up 
to a multiplicative constant [ltA l2(| . It is for this reason 
that we extend the definition of the steady state Gibbs' 
entropy to time dependent (non-equilibrium) situations 
and say that the time dependent Gibbs ' entropy of a den- 
sity f(t,x) is defined by 



H G (f) 



f(t,x) log f(t,x)dx. 



X 



We define the conditional entropy as [21| 



H c (f\f* 



,,. \ -i f(t,x) 
fi^x) log dx. 
x f*{x) 



(2.2) 



(2.3) 



It is variously known as the Kullback-Leibler or relative 
entropy [lj , the relative Boltzmann entropy [22L |23| , or 
the specific relative entropy p3 |. and has been related 
to the free energy p| |(J |25j. If there is a convergence 
lim^oo f(t, x) — (x) in some sense (which we will make 
totally precise in Section llVjl then lim^oo H c {f\f af ) = 0. 



III. 



ENTROPY BEHAVIOR AND INVERTIBLE 
DYNAMICS 



This section considers the behavior of the Gibbs' en- 
tropy and the conditional entropy in situations where the 
dynamics are invertible in the sense that they can be run 
forward or backward in time without ambiguity. To make 
this clearer, consider a phase space X and a dynamics 
S t : X — > X. For every initial point xo, the sequence 
of successive points St(xo), considered as a function of 
time t, is called a trajectory. In the phase space X, if 
the trajectory St(xo) is nonintersecting, or intersecting 
but periodic, then at any given final time tf such that 
Xf = St f (xo) we could change the sign of time by re- 
placing t by — t, and run the trajectory backward using 
Xf as a new initial point in X. Then our new trajec- 
tory S-t(xf) would arrive back at xq after a time tf had 
elapsed: xq — S-t f (xf). Thus in this case we have a 
dynamics that may be reversed in time completely un- 
ambiguously. Dynamics with this character are known 
variously as time reversal invariant |26j| , or reversible 
in the physics literature, and as invertible in the mathe- 
matics literature |2*lj . 

We formalize this by introducing the concept of a dy- 
namical system {<S't} te ;R / , which is simply any group of 
transformations St : X — » X having the two properties: 
1. S (x) = x; and 2. S t (S t ,(x)) = S t+t <(x) for t,t' € R 
or Z. Since, from the definition, for any t € Et, we have 
St(S-t(x)) — x = S-t(St(x)), dynamical systems are in- 
vertible in the sense discussed above since they may be 
run either forward or backward in time. Systems of or- 
dinary differential equations are examples of dynamical 
systems. 



Our first result from shows that the conditional en- 
tropy of any invertible system is uniquely determined by 
the system preparation and does not change with time. 
This is formalized in 



Theorem 1 ffla. Theorem 3]) If P* is an invertible 
Markov operator and has a stationary density /», then 
the conditional entropy is constant and equal to the value 
determined by /» and the choice of the initial density fo 
for all time t. That is, 



HdP'folf.) = ff c (/o|/*) 



for all t. 



More specifically, when considering a deterministic dy- 
namics 5* : X — * X, the corresponding Markov operator 
is also known as the Frobenius Perron operator [21j and 
is given by 

P t fo(x) = f (S- t (x))\J- t (x)\, (3.1) 
where J~ t (x) denotes the Jacobian of S~ t (x). Further, 

'P'foix)' 



tf c (P7o|/*) 



X 



P'foix) log 
\J*(x)\ 



dx 



log 



f*(x) 



-L^Hm 

= ffc(/o|/*) 



dy 



dx 



as expected from Theorem^ This behavior is, however, 
quite different from what is seen in the Gibbs' entropy 
since 

H G (P t f ) = - f P t f (x)log[P t f (x)]dx 
Jx 



X 



|J'(*)| 



fo(y) log 



H G (fo) 



log 

My) 



fo(S-\x)) 



\.P(x)\ 
dy 



dx 



\J f (y)\. 

o(y)log\ J* (y)\dy. 



x 



Thus, in spite of the fact that the conditional entropy 
is constant for an invertible system, the Gibbs' entropy 
may continually change, and satisfies 

# G (PVo) - H G (f ) = f f (y) log \J\y)\dy. (3.2) 
Jx 

Note in particular that for the Gibbs' entropy to be an 
increasing function of time, we must have an expanding 
dynamics in the sense that 



x 



/ (y){log|J t ( 2 ;)|-log|J t '|}dy>0 



for t > t'. 
(3.3) 
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When the Jacobian is constant, 

H G (P t f )-H G (f Q )=log\J t 



(3.4) 



illustrating that the Gibbs' entropy Hc(P t fo) may ei- 
ther deviate from or approach the initial entropy Haifa) 
depending on the value of | J* | . If the Lebesgue measure 
is preserved so |J*| = 1, then Hq is constant. 

Taking an even more specific example, if the dynamics 
corresponding to the invertible Markov operator are de- 
scribed by the system of ordinary differential equations 



dxi 
~~dt 



Fiix) 



1, 



(3.5) 



operating in a region X C R d with initial conditions 
Xi(0) = Xifi, then [21| the evolution of /(t, x) = P'/o(x) 
is governed by the generalized Liouville equation 



df = _ V 9(/F,; 
dt 



dx t 



(3.6) 



If the stationary density /* exists, it is given by the so- 
lution of 



dxi 



(3.7) 



Note that the constant function /* = 1, meaning that the 
flow defined by Eg . 13 . 51 preserves the Lebesque measure, 
is a stationary solution of Eq. 13.61 if and only if 



^ dx, 



0. 



(3.8) 



but if X has an infinite Lebesgue measure then is not 
integrable, so there will be no stationary density. 
The rate of change of the Gibbs' entropy is given by 



dHc 
dt 



(3.9) 



and so it is only in Lebesgue measure preserving dynam- 
ics (like Hamiltonian systems), for which Eg. 13.71 holds, 
that Hq will be constant. This was first noted by Gibbs 
0, pp. 143-4] and much later pointed out in ^| and 
proved in general in [29|. as emphasized in [ljj. If 



(3.10) 



where F = (i 7 ^ ) is a 2x2 matrix. It can be solved exactly 
and its solution is given by 



xit) = e t *x(0) ) 



where 



V —F n . 



n=0 



The evolution of the density f under the action of this 
flow is determined by the solution of the Liouville equa- 
tion 



d£ djF 1 jx)f) _ djF 2 jx)f) 
dt 



dxi 



dx 2 



(3.12) 



where Fjix) = FjiXi + Fj 2 X2, j = 1,2. // the initial 
density is given by foix), then the general solution of 
Eq. \3.1£\ is given by 



/(M) = |det e -"|/ (e-"x) 



Since 



|dete- tf | 



-tTrF 



where Tt F = Fn + F22 is the trace of the matrix F , we 
have 

P t foix)=e-^ F foie- tF x). 

Consequently, we obtain 

HaiP'fo) = H G if ) + tTrF. 

If X\, X2 are the eigenvalues of F then Tr F = Ai + A2. 
Thus when Tr F < then the system has a one dimen- 
sional attractor and Hq[P 1 fo) — > —00 as t — > 00 , while 
if Tr F > then the dynamics are sweeping fj?ij / . How- 
ever, in this example there will be no stationary density 
and the conditional entropy is thus not defined. 

Example 2 Consider the second order system 

d 2 y dy 



m ^ + ^ft +Uj2y = ° 



(3.13) 



with constant coefficients m, 7 and uj. Introduce the ve- 
locity v = y as a new variable. Then Eq. 13.131 is equiva- 
lent to the system 



d -l=v 
dt 

dv 2 
to— = -jv -uj y, 
dt 



(3.14a) 
(3.14b) 



thus by writing 



then the Gibbs' entropy will increase. 

Example 1 To illustrate these points, consider the con- 
tinuous time dynamical system on R 2 



d.r 
~dt 



Fx 



(3.11) 



and 



F 



1 

uj 2 7 

TO TO 



we recover Eg. \3.1l\ Since Tr F = —7/771, we obtain 
P'foix) = e^ m f ie- tF x) 
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and 



HciP'fo) = H a (fo) 



It 



As in Example ^\ when there is damping so Tr F — 
—j/m < 0, then HqIP 1 fo) — * — °o as t — > oo. Fur- 
ther, as in the previous example there is no stationary 
density /* and so H c (f\f*) is not defined. 

Example 3 Let X be the unit circle in R 2 . If 



F = 



1 



-1 

then Eq. \3.11\ has the general solution 

cost sini 



x{t) 



sin t cos t 



x(0) 



and x(t) € X for x(0) £ X. If fi is the Lebesgue measure 
on X then the corresponding Perron- Frobenius operator 
is given by 

P t fo(x)=fo(x(-t)) for f Q ^L\X) 

and f*{x) = —lx(x) is the stationary density of P l . 
We then have 

H c (P t f \f*)=H G (P t f )-log2w 

= # G (/o)-log27r = H c (/ |/*) 

and both entropies are constant and fixed by the initial 
system preparation (fo)- 



IV. ENTROPY BEHAVIOR AND 
NON-INVERTIBLE DYNAMICS 

A. Asymptotic stability and conditional entropy 

A semigroup of Markov operators P t on L 1 (X) is said 
to be asymptotically stable if there is a stationary density 
/* of P f such that for all initial densities fo 

lim P*/o = /* 

t — >oc 

(here the limit denotes convergence in L 1 {X)). Systems 
with dynamics that are asymptotically stable must, by 
necessity, be non-invertible |2lt Remark 4.3.1]. 



Theorem 2 ( \3ui ) Let P l be a semigroup of Markov op- 
erators on L 1 (X) and /» be a stationary density. Then 
for every density fo the conditional entropy -ff c (P* fo\f*) 
is a nondecreasing function oft. 

For a given density fo the conditional entropy 
H c (P t fo\f*) is bounded above by zero. Thus we know 
that it has a limit as t — > oo. Our next result connects 
the temporal convergence properties of H c with those of 



Theorem 3 (\18l. Theorem 1]) Let P* be a semigroup 
of Markov operators on L 1 (X) and be a stationary 
density. Then 

lim P c (P7o|/*) = 

t — >oo 

for all fo with H c (fo\f*) > — oo if and only if P* is 
asymptotically stable. 

A consequence of the convergence of the conditional 
entropy to zero is that 



lim / h(x)P t fo(x) dx — j h(x)f*(x)dx 



for any measurable function h for which the integral 

e rh ^U(x)dx 

is finite for all r in some neighborhood of zero [sil Lemma 
3.1]. Since the conditional and Gibbs' entropies are re- 
lated by 

P G (P7o) = ffc(P7o|/*) - / P*/o(aO log/*(z) dx, 
Theorem implies 

Theorem 4 Let P be an asymptotically stable semi- 
group of Markov operators on with a stationary 

density such that / fl +r {x) dx < oo for all r in some 



neighborhood of zero. Then 

lim P G (P7o) = H G {U) 

t — >oc 

for all fo with H c (f \f*) > -oo. 

Theorem |3 shows that asymptotic stability is neces- 
sary and sufficient for the convergence of H c to zero. A 
weaker property for entropy con verg ence has been pre- 
viously considered by Ruelle |32j, |33j and later popular- 
ized 13113 as a 'chaotic hypothesis' [3(j- The chaotic 
hypothesis postulates that underlying dynamics are (in- 
vertible) Anasov systems. 



B. Effects of noise in continuous time systems 

In this section, we consider the behavior of the en- 
tropies Ha(P t fo) and H c {P l fo\f*) when the dynamics 
are described by the stochastically perturbed system 



dxi 
~~dt 



= Fi(x)+J2°ij(x)Zh i = l,...,d (4.1) 



with the initial conditions Xi(0) = Xi t o- o~ij(x) is the am- 



plitude of the stochastic perturbation and £j 



dwj 
~dT 
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a white noise term that is the derivative of a Wiener 
process. It is assumed that the Ito, rather that the 
Stratonovich, calculus, is used. (For the differences see 
|37|. plj and (3^. If the are independent of x then 
the Ito and the Stratonovich approaches yield identical 
results.) 

The Fokker-Planck equation governing the evolution of 
the density function f(t,x) is given by 



df 
dt 



■E 



d[Fj(x)f] 

dx,. 



1 d 

E 



<:) 2 



dxjdxj 



where 



(4.2) 



Differentiating Eg. 12. 21 with respect to time, and using 
Ea. 14. 21 with integration by parts along with the the fact 
that since /* is a stationary density it satisfies 14.4JI . we 
obtain 



dt 



7)^^Au)dx-\S) dx - 

(4.5) 

Since the matrix (ay (x)) is nonnegative definite, one con- 
dU 

eludes that > 0. Using the identity 



/(*) 



k=l 



(Tik(x)o-jk(x). 



If k(t ,x,xq) is the fundamental solution of the Fokker- 
Planck equation, i.e. for every xq the function (t, x) i— > 
k(t, x, xq) is a solution of the Fokker-Planck equation 
with the initial condition 5(x— xq), then the general solu- 
tion f(t, x) of the Fokker-Planck equation (|4.2(l with the 
initial condition /(x,0) = fo(x) is given by 



f(t,x) = / k(t, x,x )fa(xo)dx , 



(4.3) 



and defines a Markov semigroup by P t fo(x) = f(t,x). 

If a stationary (steady state) density f*(x) exists, it is 
the stationary solution of Eq. 14.21 



d[Fj(x)f] 
dxi 



1 d 



d 2 [a ij (x)f] 
dxidxj 



(4.4) 



JL (logL) = ^— ( — ) 

dxi V /*/ / dx t V/* 



we can rewrite Eq. 14.51 in the equivalent form 



^ -IJft^)^ ^ (tag£) dx. 

(4.6) 

The right hand side of Eo. 14.61 appears in various expres- 
sions describing entropy balance equations in Daems and 
Nicolis [3 and Bag |l5j . 

A similar calculation for the Gibbs' entropy yields, 
however, something additional. Namely, we have 



dH G 
dt 



-ME 



dFjjx) 
dxi 



d 2 a i0 (x) 
dxidxj 



dx m ./ 7 ^ aii{x) ^^ dx - 

J i->3 — 1 



(4.7) 



If a,ij are independent of x then we obtain 
dH G f dF^x) 1 A [Idfdf 

(4.8) 

As pointed out in the first term is of indetermi- 
nant sign, while the second is positive definite so the 
temporal behavior of the Gibbs' entropy in this non- 
invertible system is unclear. It has become customary 
O Eil E 03 El E§| to refer to the first term in 
Eq. 14.71 as the 'entropy flux' and the second term as the 
'entropy production'. 

There are a number of results giving conditions such 
that the general solution f(t,x) of the Fokker Planck 
equation is asymptotically stable and thus the condi- 



tional entropy evolves monotonically to zero, e.g. The- 
orem 11.9.1 in |21j. In particular, assume that the sta- 
tionary density is of the form 

/*(zMe- B M 

From Theorem [3] it follows that 

km H e (f\f m ) = 

and from Theorem Hthat 

lim H G {f)=H G {U) 

t — >oc 

for all /o with -ff c (/o|/*) > — 00 provided that 
J e _ ( 1+r ' B ( a: ^c?x < oo for r in some neighborhood of zero. 
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From the definition of the conditional entropy we may 
write 

H c {f\U)=H G {j)+ [ f(t,x) log f*(x)dx (4.9) 

so the derivative of the Gibbs' entropy is 
dH G dH, 



J L f log f*dx, (4.10) 



dt dt 
where the operator L is given by 



Lf _ j^ d(F t (x)f) | 1 ^ d 2 {a %3 {x)f) ^ (4 |;|) 



dxjdx 



i—l ' ij — 1 

Since log/*(x) = —B(x), we may write 
dH G dH c f 



(4.12) 



where the operator L is the formal adjoint of the oper- 
ator L in Ea. l4"TTl If / e -B(x)+rL- B(x) dx < ^ for r in 
some neighborhood of zero, then 



lim / fL~Bdx= \ f*L~Bdx = \ Lf*Bdx = 0, 



which implies 



.. dH G dH c 
hm — ; — = hm — - — 

t^oo dt t^oo dt 



The one dimensional case 



In a one dimensional system (d = 1) the stochastic 
differential Eq. 14.11 becomes 



dx 
~db 



F{x)+a{x% 



(4.13) 



where £ is a (Gaussian distributed) perturbation with 
zero mean and unit variance, and o~{x) is the amplitude 
of the perturbation. The corresponding Fokker-Planck 
equation is 



d£ = d[F( x )f] | i ay(s)/] 

dt 



dx 



dx 2 



(4.14) 



If stationary solutions f*(x) of (|4.14l) exist, they are 
defined by P*/* = /* for all t and given as the generally 
unique (up to a multiplicative constant) solution of 



d[F(x)f4 , ld 2 [a*(x)f, 



dx 2 dx 2 

The integrable solution is given by 



= 0. 



f*(x) 



K 



a 2 {x) 



exp 



2F(z) 
a 2 (z) 



d.z 



(4.15) 



(4.16) 



where K > is a normalizing constant and the semigroup 
P* is asymptotically stable. 

It is known 0, Section IV] that under relatively mild 
conditions there exists a constant A > such that 

H c {P l h\f*) > e- 2Xt H c {f Q \U). 

Specific examples of o~(x) and F{x) for which one can 
determine the solution f(t,x) of Eq. 14.141 are few. One 
is that for an Ornstein-Uhlenbeck process which we con- 
sider in our next example. 

Example 4 In considering the Ornstein- Uhlenbeck pro- 
cess, developed in thinking about perturbations to the ve- 
locity of a Brownian particle, we denote the dependent 
variable by v so o~(v) = a a constant, and F(v) = —71" 
with 7 > 0. Now Eq. \4-13\ becomes 

dv 

—"fv + at, 



dt 

with the Fokker-Planck equation 

df _ d[ 7 vf] , a 2 d 2 f 



(4.17) 



dt dv ' 2 dv 2 
The unique stationary solution is 



^idr- (4-18) 



/*(«) 



r°°e-fv 2 /° 2 dv 
j —00 



2 r -i v 1° 
1 



(4.19) 



// the initial density f is a Gaussian of the form 



fa(v) 



1 



exp 



CTV27T 

where a > and »eR, then 
1 



P'foiv) 
wherein 



o- t y2-K 



exp 



(v — v) £ 
2a 2 



(v-v(t)f 



2af 



JL „2 1 (-1 J\. -27t 
CT t = CT * + ( CT - °*) e 

wii/i <r 2 = cr 2 /27 and 

u(t) = ve-^. 
The Gibbs' entropy is 

H G {P i f )=\oga t V2^+- r 



(4.20) 

(4.21) 

(4.22) 
(4.23) 

(4.24) 



Also 

f +00 



/ P'/o(^)log/*(^ = -log^V2^---|, (4.25) 
J-00 2 cr„ 



•so 



H c (P t fo\f*) = -log 



- 2 logO 



1 

+ 2 



<7 2 



3- 1 



(4.26) 



2 6 



-27* 
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We may examine how the two different types of entropy 
behave. First, we may show that H C (P /o|/*) > with 



dt 



t=o 



R 



> 



> 





for 


a 2 


< °l 







for 


a 2 


= °l 


< 





for 


a 2 





and H C (P fo\f*) increasing in a monotone fashion, with 

lim d Jh^MlA = o, 

t^oo dt 

wherein R = a 2 /a 2 . 

This is not the case with the Gibbs' entropy, for 



dHajptfo) 
dt 



implying that the evolution of the Gibbs' entropy in time 
is a function of the statistical properties (a 2 ) of the ini- 
tial ensemble. All of these conclusions concerning the 
dynamics of HG(P t fo) are implicit in the work of Bag 
lla] but not explicitly stated. 

Similar effects can be observed for the Rayleigh process 
considered in |l8L Section IV]. 



2. Multidimensional Ornstein- Uhlenbeck process 

Consider the multidimensional Ornstcin-Uhlcnbeck 
process 



dx 
~dt 



Fx + ££, 



(4.28) 



where F is a d x d matrix, E is a d x d matrix an £ is 
d dimensional vector. The formal solution to Eg. 14.281 is 
given by 

x{t) = e tF x(0) + [ e^-^E dw(t), (4.29) 



where e tF = V°° n KF n is the fundamental solution to 

X(t) = FX(t) with X(0) = I, and w(t) is the standard 
<i-dimcnsional Wiener process. From the properties of 
stochastic integrals it follows that 

n(t) = [ e^ F Sdw(t) 
Jo 

has mean and covariance 

R(t) = Erj(t)r](t) T = / e^SS 7 'e spJ ds, (4.30) 
Jo 

where F T is the transpose of the matrix F . The matrix 
R(t) is nonnegative definite but not necessarily positive 
definite. We follow the presentation of ^(j an d |4l|. For 



each t > the matrix R(t) has constant rank equal to 
the dimension of the space 



F, E] := {F'-^ej :l,j = l,...,d,e j = (S ju 



'}■ 



If / = ranki?(i) then d — I coordinates of the process n(t) 
are equal to and the remaining / coordinates constitute 
an Z-dimensional Gaussian process. Thus if I < d there is 
no stationary density. If ranki?(t) = d then the transi- 
tion probability function of x(t) is given by the Gaussian 
density 



k(t,x,x ) = 



exp{-±(z - e tF x ) T R^)- 1 (x - e tF x )} 



v / (2n) d detR(t) 

(4-31) 

where R(t) 1 is the inverse matrix of R(t). An invariant 
density /* exists if and only if all eigenvalues of F have 
negative real parts, and in this case the unique stationary 
density /* has the form 

fJx) = —== 1 exp \-~x T R- x x\ , (4.32) 

V ; ^(27r) rf deti?, "I 2 J ' V ' 

where i?* is a positive definite matrix given by 



i?* = 



e sF EE T e sF ds 



and is a unique symmetric matrix satisfying 

FR* + R*F T = -EE T . (4.33) 

We conclude that if [F, E] contains d linearly independent 
vectors and all eigenvalues of F have negative real parts, 
then the corresponding semigroup of Markov operators 
is asymptotically stable. From Theorem[3]it follows that 

lim ff c (P'/o|/*) = 

r— >oo 

and from Theorem 0] that 

lim Hciptfo) = H G {U) 

t— *0O 

for all f with H c (f \f*) > -oo. 

Now let fo be a Gaussian density of the form 



fo(x) 



1 / 1 m-i 1 

exp < — —x U n x> 



(4.34) 



where Qo is a positive definite symmetric matrix. From 
Ea. l4.29l it follows that x(t) is Gaussian with zeroth mean 
vector and the following covariance matrix 

Q{t) = e tF Qoe tpT +R(t). (4.35) 
Hence the density of x(t) is given by 

P t Mx) = 1 = exp\~l-x T Q{t)- 1 x\ . 



(4.36) 
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Since J P t fo(x)x T Q(t) 1 xdx — d, the Gibbs' entropy of 
P'fo is 



H G (P t fo) = \log(2Tr) d detQ(t) + ^ 
By Eq. 14.91 and the formula 

J P t f (x)x T R- 1 xdx= Tr(i?- x Q(t)) 
we obtain the conditional entropy 

ffc(P*/o|/*) = Hairdo) - ilog(2^) d deti?„ 



(4.37) 



(4.38) 



for all t > and every f of the form given by Eq. 14.341 
Formula 14 . 3 71 remains valid when we start with a Gaus- 
sian density f with non zero mean vector but then in the 
formula for the conditional entropy one additional term 
appears, see 0, Section IV]. 

Example 5 Noisy harmonic oscillator. 
Consider the second order system 



d 2 y dy 2 



(4.39) 



with constant positive coefficients to, 7 and a. Introduce 
dy 

the velocity v = — as a new variable. Then Eq. \4-39\ is 

equivalent to the system 



dt 

dv 2 
to— = -jv - w y + of , 
dt 



(4.40a) 
(4.40b) 



and the corresponding Fokker-Planck equation is 
df _ d[vf] , 1 dihv + ^y)/} a 2 d 2 f 



dt 



dy to 



dv 



2m 2 dv 2 



We can assume in what follows that m = 1, as introduc- 
ing the constants 7 = j/m, uj 2 = ui 2 /m and a 2 = a 2 /m 2 
leads to 

df d[vf] , d[tfv + <J 2 y)f] a 2 d 2 f 

2 dv 2 ' 



dt 



dy 



dv 



The results of Section \IVB 2\ in the two dimensional 
setting apply with x = (y,v) T , 

F={ I 2 - 7 )' and s= (o I)' 



Since 



the transition density function is given by Eq. \4-31\ The 
eigenvalues of F are equal to 



-7 + \/l 2 - 4w 2 
Ai = 7 V 7 , (4.41a) 



A 2 



-7 — -\/7 2 — 4w 2 



(4.41b) 



and are either negative real numbers when 7 2 > Alo 2 or 
complex numbers with negative real parts when 7 2 < Auj 2 . 
Thus the stationary density is given by Eq. \4-32\ As is 
easily seen R*, being a solution to Eq. \4-33\ is given by 



o* (1 

2 7 a; 2 \0 uj 2 



The inverse of the matrix R* is 

! = 27 (u 2 
cr2 I 1 



and the unique stationary density becomes 

7 

' r 2 2 1 2l 

7(x> a + 11 1 



f*(y, v ) = — o e a 

Ira'* 

If the initial density fo is the Gaussian 



1 



9 2 

y z v 



/o(2/ ' u)= 2^ eXP \ 2a 2 2a 2 /' 
where o\ > 0,tJ2 > 0, £/ien P'/o is as in Eq. \4-3b\ with 
Q{t) = e tF Q e tFT + R(t), 

where 



g ° - I a 2 



(4.42) 



#(t) = / e 
Jo 



a" 



- ' ' ° 2 ) e'^da. (4.43) 



TTie formula for the covariance matrix R(t) is given by 
Chandrasekhar '42, pp. 27-30]. The Gibbs' entropy is 



H G {P l h) = 1 + log(27r) + - logdet Q(t) (4.44) 
and the conditional entropy is 
ff c (P*/o|/*) = l + ilogdetQ(i)- X - logdet fl. 



1 



(4.45) 



We are going to show that the Gibbs entropy need not 
be a monotonic function of time, so we need to calcu- 
late detQ(i) to have the analytic formula for the Gibbs 
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entropy. The calculations depend on the nature of eigen- 
values Ai and X 2 in Eq. \4-41\ so we must distinguish 
between three cases: (i) Ai,A 2 G R with \\ 7^ A2, (ii) 
Ai, A2 £ R with Ai = A2, and (Hi) Ai,A2 are complex. 
In what follows we use the following notation 

(4.46a) 



" 2 7 w 2 ' 

ai = a x — ct*, 

_ 2 2 
&2 — o~ 2 — u> c* 



(4.46b) 
(4.46c) 



Observe that a±a 2 — det(Qo ~ R*) and o~ 2 u} 2 = deti?*. 
(i) Let us first consider the overdamped case 

7 2 > 4w 2 , 



so the eigenvalues in Eq. \4--jl\ are real and Ai ^ X 2 . De 

fine, for t > 0, 



Then 



ci(t) 
c 2 {t) 

„tF 



A 2 e Alt - Aie A2t 



A2-A1 

,Ai t 



A2 — Ai 



Cl(t) 02 (t) 

ci(t) c' 2 (i) 



(4.47a) 
(4.47b) 



and £/ie covariance matrix R(t) is given by 

„2 



R{t) = R* — 



c\ + to 2 c 2 



2 „2 



7 W C2 

2 7 ^ V -Wcl (c[) 2 +u; 2 (c' 2 ) 2 



where we suppressed the dependence of c\ and c 2 on t. 
Accordingly, for Qo as in Eq. \4-VA we have 

JFn JF T - ( c i^i + c 2^2 cic^a- 2 + c 2 d 2 a\ 
Q0€ ~ { cxcja? + c 2 c' 2 a 2 (c' x ) 2 af + (c' 2 ) 2 a 2 



From Eq. \4-4'A it follows that 



C\C X + a; c 2 c 2 



2 2 
-70; c 2 . 



Combining the three preceding equations and introducing 
the values of a*, ot\, and a 2 from Eq. \4-4°\ we obtain for 
the matrix Q(t) the formula 



O(t) = ( C i ai + C2a2 + °* cic[a>i + c 2 c' 2 a 2 
^' \ cic^ai + c 2 c' 2 a 2 (ci) 2 ai + (c' 2 ) 2 a 2 + u 2 o* 

Hence 

detQ(i) = uj 2 a 2 + ct\et 2 {c\c 2 — c'^) 2 

+ a* ((u 2 c 2 + K) 2 ) ai + (u 2 c 2 + (c' 2 ) 2 ) a 2 ) 

Making use of Eq. \4-4^\ together with the relations \\ \ 2 = 
lu 2 and Ai + A 2 = —7, we arrive at 



detQ(i) = u 2 al 



r a\a 2 e 



-27* 



( 7 A 1 (A 2 a 1 +a 2 )e 2Alt 



(Ai - A 2 ) 2 

+Auj 2 (uj 2 a 1 + a 2 )e~ 7t + 7A 2 (A 2 «i + a 2 )e 2A2t ) 



Consequently, after some algebra we obtain 
dH{P l f ) _ 7 (aia 2 e~ 2 ^ + a, (c 2 u 4 ai + (c 2 ) 2 a 2 )) 



dt 



det Q(t) 



and 



(4.48) 



dt 



7"2 



t=0 



< for a 2 > 0, 
> for a 2 < 0. 

(4.49) 

Since 7 > and det Q(t) > 0, the sign of the derivative 
of Hg{P /o) i> s completely determined by the remaining 
parts and depends on the sign of a.\ and a 2 and their 
mutual relations. In the case of ot\a 2 — we conclude 
from Eqs. \4-4$\ and \4-4(\ that 



dg G (P f /o) 
dt 



/ 





for 


> 

< 





for 


< 





for 



"1 - 

=2 



<7* 
= (7* 



a 2 = uj^a*, 
a 2 < w 2 (T*, 



(4.50) 

for all t > 0. Now assume that ct\a. 2 7^ 0. It also follows 
directly from Eq. \4-4<A that 

dH G (P f f ) 



dt 



< for a{ > o-*,a 2 > oj z a*. (4.51) 



This behavior is illustrated in Fig. QJ 





FIG. 1: Entropy behavior for the overdamped noisy harmonic 
oscillator. The left hand panels show plots of Hq(P fo) as 
a function of time as given by Eq. 14.441 and the right hand 
panels show H^P 1 /o|/*) (as in Eq. 14.4511 plus Hc{f*), i.e. 
H c (P t fo\f*) + Hc(f*) as a function of time. The parameters 
used were m = 1, 7 = 3, lu 2 = 2, and a„ = 1. Upper 
panels correspond to the range of parameters as in Eq. 14.511 
with specific values o\ = 2, a<2, = 2, while the lower panels 
correspond to parameters as in Eq. l4.56l with a\ = 0.5, 02 = 1. 

To study the remaining cases we rewrite Eq. \4-4&\ 7 ' n 
the form 

^ G(Pt/o) - 7 -e- 2 ^ hl (t), (4.52) 



dt 



det Q(t) 
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where 
h x {t) 



-Oil 



a 2 — c* (Ai/3ie 

7 



2A 2 t 



A 2 /3 2 e 



-2Ait\ 



Pi 
02 



A^AS-ai + a 2 ) 
(A!-A 2 ) 2 ' 
A 2 (A 2 ai + a 2 ) 



(4.53) 

(4.54a) 
(4.54b) 



(Ai-A 2 ) 2 • 
Since AiA 2 = u 2 , we obtain 

h[(t) = 2w 2 a* ({3 ie - 2X2t - (13, + p 2 )e~^ + /3 2 e- 2Alt ; 
which leads to 

h[(t) = 2 W Ve~ 2Alt U Xl ~ x ^* - l) (fte^ 1 "^" - ft 
For > such that fte (Al ~ A2)t ' = ft we Ziaue 

7/(Ai-A 2 )\ 



hi(t* 



-ai \ a 2 + lu <r* 



(4.55) 



Returning to formulae \4-54l we note that 
0i , (Ai - A 2 )(w 2 ai - a 2 ) 



ft 



1 



Ai(A|ai + a 2 ) 



We can now continue to study the of behavior of 
Hg(P fa)- First, we consider the case of ct\ < and 
a 2 < 0. Ifup-ax > a 2 then hi(t) > hi(0) and hi(0) > 



by Eq _ 
from Eq 
we obtain 

dH G (P f f 



Now if uP'ctx < a 2 then h\(t) > h\(t*) 
it follows that /ii(i») > 0. Consequently, 

■>0 for a 2 < o*,a\ < uj 2 a*. (4.56) 



dt 

Consider now the case of u\ > and a 2 < 0. Then 
we know that hi(0) > 0. Now if A|ai + a 2 > then 
Pi < and Pi < ft. Thus hi is decreasing and diverges 
to — oo as t — » oo. Consequently, if X 2 a\ > —a 2 > 0, or 
equivalently 



j 2 + 7A 2 f7* > and < tu a* 
then there is to > such that 
dHaiptfo) 



dt 



> 
< 



for 
for 



t < t Q , 
t > t . 



(4.57) 



(4.58) 



If \ 2 ai + a 2 < then Pi > awe? ft /ft > 1. From 
Eq. \4 ■ 55\ it follows that hi(t*) < 0. Thus hi starting 
from a positive value at decreases to a negative value 
at t* and then increases and diverges to oo. Hence we 
conclude that, if0< X 2 ai < —a 2 , or equivalently 



X 2 cr 2 + O2 + 7A 2 cr» < and a\ > <7* 



(4.59) 



FIG. 2: Overdamped noisy harmonic oscillator. Plots and 
parameters as in Fig. but now upper panels are for the 
range of parameters as in Ea. 14.571 with o\ = 2, 02 — 1, and 
lower as in Eq. 14.591 with o\ — 1.1, 02 = 0.1. 



then there are ti , t 2 > such that 
dt 



> 





for 


0<t<ti, 


< 





for 


tt<t< t 2 , 


> 





for 


t > t 2 . 



(4.60) 



These behaviors are illustrated in Fig. 

A symmetric behavior is observed when ai < and 
a 2 > 0, and graphically shown in Fig. We then have 






FIG. 3: Overdamped noisy harmonic oscillator. Plots and 
paramenters as in Fig. ^ but the upper panels are for the 
range of parameters as in Eq. l4.6ll with a\ = 0.5, 02 = 2, and 
lower as in Eci. I4.63) (Ti = 0.5, <J2 = 3. 

hi(0) < and a similar analysis leads to the following 
conclusions. If \\ct\ < —a 2 < 0, or equivalently 

\ 2 cr 2 + u\ + 7A 2 <7* < and a\ > u> 2 a„, (4.61) 
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then there is to > such that 

dHaiPtfo) f < /or t<t„, 



so that Ai = A2, and set 



(4.62) 



(4.63) 



di 1 > for t>t 
and if > X\a\ > — a^, or equivalently 

X\a\ + a\ + 7A2CT* > and a\ < d* 
then there are ti,t 2 > swc/i t/iat 

dff G (P'/c,) 
df 



('u) Lei us now consider the critical damping situa- 
tion when 



7 2 = Auj 2 , 



A = 



2 
2' 



In this case we have 



P - i 1 

h - [ -A 2 2A 



and e tF = e At 1 , ; . 



1 - Xt t 
-\ 2 t 1 + Xt I ' 



< 





for 


0<t<ti, 




so that the corresponding covariance matrix R(t) is given 


> 





for 


h<t < t 2 , 


(4.64) 


by 


< 





for 


t > t 2 . 







R(t) = R« 



<r z e ZM ( {l-Xt) 2 + X 2 t 2 
4A 3 



3i2 



2A J i 

2\H 2 (A + A 2 i) 2 + A 4 i 2 



We also have 



tFs*. tF T 2Xt 

e Qoe = e 



a 2 (l- \t) 2 +a 2 t 2 



a 2 X 2 t(l - Xt) + ait(l + Xt) 



-a 2 X 2 t(l - Xt) + o 2 t{\ + Ai) a 2 A 4 i 2 + u\{\ + Ai) 2 
I 



Note that now cr* = -rr and lu 2 — X 2 . Thus 

4A 3 



Q(t) 



e 2Xt ( ai (l - Xt) 2 + a 2 t 2 ) + a, e 2Xt (-A 2 i 2 (l - Xt)a x + i(l + Xt)a 2 ) 



where a\ and a 2 are given by Eq. \4--jb\ Hence 

det Q{t) = X 2 a 2 + ai a 2 e 4Xt + a*e 2Xt ( ai X 2 ((l - Xt) 2 
+ X 2 t 2 )+a 2 {(l + Xt) 2 + X 2 t 2 )) 

and after some algebra we obtain 

dH G (P*f ) _ 2A 



4At 



dt 



detQ(i) 
+ o%,a 2 (l + Ai) 2 e- 2At ). 



A 2 i 2 (l - Xt)ai + t(l + Xt)a 2 ) e 2Xt { ai XH 2 + a 2 (l + Xt) 2 ) + X 2 a 

I 

where now 

h 2 {t) = -a x a 2 - er*e~ 2At (aiA 4 i 2 + a 2 (l + Ai) 2 ) . 
Then 

h' 2 (t) = 2X 2 a*e~ 2Xt t (X{X 2 a x + a 2 )t - (A 2 cn - a 2 )) 
Note that for 

A 2 cn 



(a\u 2 + er»aiA i e 



4 ,2 -2At 



a 2 



(4.65) 



A(A 2 ai + a 2 ) 



we have 



Since X = —7/2, Eq. \4-4^[ remains valid. Now the anal- 
ysis and conclusions are similar to the overdamped case. 
First, observe that from Eq. \4-65\ follow Eq. \4-5tJ[ in the 
case of a.\a 2 ~ and Eq. \4- ol\ in the case of positive ct\ 
and a 2 , so assume that a\a 2 ^ 0. Let us rewrite Eq.^~ 
in the form 



h 2 (U) = -ai(a 2 + A 2 cr*e- 2At *) 



dHgjptfo) 
dt 



detQ(i) 



- 27t h 2 (t), 



A similar analysis as in the overdamped case leads to the 
same conclusions so that Eq. \4-5b] remains valid in the 
case of negative ol\ and a 2 and also Eqs. \4-58$[4~(>4] hold 
in the same ranges of parameters in the case of ct\a 2 < 0. 
(Hi) Finally, let us consider the underdamped case 

7 2 < Auj 2 , 
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so that Ai,A2 are complex, and set 

and (3 = \/ io 2 — A 2 . 



A = -? 



Then Ai = A + i(3 and A 2 = A — T/ie fundamental 
matrix in this case is equal to 



(3cos((3t) - Asin(/?i) 



sm(f3t) 



[3 \ -cj 2 sin(/3f) (3cos((3t) + Asin(/ft), 
Lei ms rewrite the matrix e tF as 



..XI 



c 3 (t) sin(/3i) 



(3 \ -u 2 sm(l3t) c A {t) J ' 



where 



c 3 (t) = /3cos(f3t) - Asin(/ft), 
d{t) = 0cos(f3t) + \sm(pt). 



(4.66a) 
(4.66b) 



Observe that cr* as defined in Eq. \4-46o\ is equal to 
—a 2 1 'AXlu 2 . The covariance matrix R(t) is equal to 



-R* — 



z 2 {t) + uo 2 sin 2 (fit) 2 Aw 2 sin 2 (/ft) 



f3 2 V 2Acj 2 sin 2 (/3i) w 4 sin 2 (/3i) + w 2 c|(i) 
Further 



,t F i H o 

a 2 



„tF 2 



(3 2 



a\c 2 3 {t) + a\ sm 2 ([3t) (-u 2 a 2 c 3 {t) + a 2 c 4 {t)) sm(f3t) 

(-uj 2 a 2 c 3 (t) + a 2 Ci {t)) sm(0t) w 4 ct 2 sin 2 (/3i) + a\c\(t) 



r 



Making use of expressions \4-4°\ and \4-b6\ the sum of the matrices in the two preceding equations gives 
I 



Q(t) 



/ e 2\t & 2\t \ 

a * + ~pT ( a i c §(*) + a2 sin 2 (/3t)) -gj" sin(/3t) (a 2 c i (t) - uj 2 aic 3 (t)) i 

g 2At g 2At 

. sin(/3t) (a 2 c 4 (i) - w 2 ceic 3 (t)) er»w 2 + (w 4 ai sin 2 (/3i) + a 2 c|(t)) 



r 



which after some algebra leads to 



AetQ(t) = w 2 cr 2 + e 4At aia 2 + * (u; 2 (a; 2 ai + a 2 ) 



/3 2 

- A 2 (w 2 ai + a 2 )cos(2/?t) 

- A/3(w 2 ai - a 2 ) sin(2/3i)) 

W^e have 
dHaiPtfo) 2A 



e 2At (a ia2 e 2Ai 



A det Q(t) 

+ ^ (co 4 a 1 sm 2 (pt)+a 2 cl(t))). 



(4.68) 



Since A = —7/2, i?g. \4-4^A holds. Again, Eq. \4-b&\ im- 
plies Eq. \4-50] in the case of a\a 2 — 0. In the case of 
positive oc\ and a 2 the Gibbs entropy is decreasing. This 
corresponds to 



a\ > a - , and a\ > u 2 o* 

and is illustrated in Fig. 01 

Let us rewrite Eq. \4-b'^in the form 



(4.69) 



dH G (P f f a ) 
dt 



7 e iM h 3 (t), 



det Q(t) 



wht 



h 3 (t) = -a x a 2 - -£e- 2Xt (wV sin 2 (/?i) + a 2 cg(t)) . 



/3 : 



(4.67) H^e /iawe 



2uo 2 a. 



*e~ 2Xt sin(/ft)(A(w 2 ai +a 2 )sin(/ft) 



/? 2 

+ /3(a 2 - uj 2 ai) cos(pt)). 

The function h 3 has extreme values at all t for which 
either sm(f3t) — or 



(3cos([3t) = Asin(ffl) (^ Q i+ Q2 ) 
\uj a u\ — a 2 ) 



(4.70) 



Making use of the relations lu 2 = A 2 + [3 2 and A = —7/2 
it is seen that for every nonnegative integer k we have 



h 3 (k?r/f3) = -a 2 (ai + a^'?) (4.71) 



and 



h 3 {U + kir/0) = -«i (a 2 + <7^V (t * +fe " //3) ) , (4.72) 
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4.35 
4.3 
4.25 







FIG. 4: Underdamped noisy harmonic oscillator. Plots as in 
Fig- but for parameters 7 = 1, to 2 — 20, ct» = 1. Upper 
panels are for the range of parameters as in Eq. 14.691 with 
<ti = 1.1 and £72 = 5, lower panels for Eg. 14.731 with o\ — 0.9, 
02 — 5. 



FIG. 5: Underdamped noisy harmonic oscillator. Plots as in 
Fig. 0] Upper panels are for the range of parameters as in 
Ed. 14. 751 with ai = 0.9 and 02 = 4, lower panels for Ea. 14.761 
with ai = 1.1, 02 = 4. 



where t* is the smallest positive solution of Eq. \4- 70] 
Thus, if ot\ < and a.2 > then h^kir / (3) < and 
hz{t-t + kit / (3) > for all k. Consequently, if 

a\ < cr» and a\ > uj 2 o-*, (4.73) 

then there are two infinite sequences of points tk and ik 
such that 

dg G (P*/o) f < Q for t k <t<ik, U7 ,, 
dt \ > for t k <t<tk+i. [ ' 

Consider now the case of ai < 0. From Eq. \4-71\ it 
follows that h3(kir//3) > 0. When a\ < the values of 
h 3 at + kir / [3 are positive. Therefore hs(t) > for all 
t > 0. Consequently, if 

a\ < a* and a\ < (jj 2 a*, (4-75) 

then the Gibbs' entropy increases. Finally, when a\ > 
then a.2 < w 2 oti , the function /i 3 decreases from a positive 
value at k-n / [3 to a negative value at t* + kir/f3 and then 
increases back to a positive value. Consequently, if 

o\ > cr» and a\ < uj 2 o-*, (4.76) 

then there are two infinite sequences of points tk and ik 
such that 

dHg{P*fo} I > for t k <t<i k , . . 

dt \ < for t k <t<t k+1 . [ ■"> 

These behaviors are illustrated in Fig. 

V. SUMMARY AND DISCUSSION 

From the most general properties of the conditional en- 
tropy, it may remain constant or increase (Theorem [2J • 



In invertible systems (e.g. measure preserving systems of 
differential equations or invertible maps) the conditional 
entropy is fixed at the value with which the system is pre- 
pared (Theorem HI see also |H El El Ei ) • This prop- 
erty is illustrated by Example [21 The addition of noise 
can reverse this invcrtibility property and induce the dy- 
namic property of asymptotic stability. Asymptotic sta- 
bility is necessary and sufficient for the monotonic evo- 
lution of the conditional entropy to a maximum value of 
zero, c.f. Theorem|3J This has been amply and fully illus- 
trated in Examples 0] and [S] for the Ornstein-Uhlenbeck 
process and a noisy harmonic oscillator respectively. 

The situation is much different for the Gibbs' entropy, 
however, and it is often difficult to make general state- 
ments about what the temporal behavior will be |28l.l2!^|. 
The rate of change of the Gibbs' entropy in invertible 
systems depends on the Jacobian (c.f. Ea. 13.9(1 . and it 
is only for Lebesque measure preserving flows that the 
Gibbs' entropy is constant. In considering the Gibbs' 
entropy in invertible systems, Example ^ treats a gen- 
eral two dimensional system. When the steady state is 
stable (Ai + A2 < 0) then the Gibbs' entropy diverges 
to —00. Alternately, when the steady state is unstable 
(Ai + A2 > 0) then the Gibbs' entropy diverges to 00. 
Example [21 considers the specific case of a damped har- 
monic oscillator in which the Gibbs entropy diverges to 
—00. Example [3] treats the measure preserving rotation 
on the circle and shows that the Gibbs' entropy is con- 
stant and fixed at the value corresponding to the way 
in which the system was prepared-as is the conditional 
entropy. 

The situation with the temporal behavior of the Gibbs' 
entropy becomes even more curious when an invertible 
system is subjected to noise and thus rendered non- 
invertible. A number of authors have considered aspects 
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of this recently, notably Ruelle Nicolis and Daems 

fTl, Daems and Nicolis 0, Bag et al. [H El, Bag 
and Garbaczewski 451. As we have shown 
in Example^] in contrast to the conditional entropy that 
increases monotonically to approach zero, the Gibbs' en- 
tropy monotonically approaches the equilibrium value of 
Hoif*) by either increasing or decreasing and the direc- 
tion of movement is totally determined by the variance 
a 2 of the initial ensemble. The temporal behavior of 
the Gibbs' entropy can, however, have even more com- 
plicated patterns as illustrated by Example |SJ There, we 
have shown that when the harmonic oscillator is either 
over damped or critically damped that the approach of 
-Hg(-P*/o) to Hc(f*) may be either monotonic increas- 
ing or increasing (Fig. or approach the equilibrium 
value with an undershoot or overshoot (Figs. |3 and |3J). 
When the harmonic oscillator is under damped then the 
approach of the Gibbs' entropy to Hc{f*) may even be 
oscillatory as shown in Figs. 01 and [S] All of these pat- 
terns of temporal behavior are, as we have shown, totally 
dependent on the relation of the variance of the initial en- 
semble to the variance of the equilibrium state. Remem- 
ber that in all of these cases (over, critically, and under 
damped) the conditional entropy smoothly approaches 
zero so H c (P* /o | /* ) + Hg (/* ) , as shown in the right hand 
panels of Figs. ^ through monotonically increases to 
approach Hc{f*)- 

The concept of entropy originally arose in the context 
of the second law of thermodynamics. Following Landau 
and Lifshitz |46| . we may formulate the second law of 
thermodynamics as follows. Let StdW be defined as 
the time dependent thermodynamic entropy. Then for 
an isolated system 

S T D{t 2 ) > S TD (h) for all t 2 >ti, (5.1) 

and there is a unique steady state 

S* TD = lim S TD (t) (5.2) 

t — >+oc 

for all initial system preparations. The entropy difference 
satisfies 



AS{t) = S TD {t)-S TD <0 



and 



lim AS(t) 

t — >-\-OG 



0. 



(5.3) 



(5.4) 



In other words, the system entropy evolves to a unique 
maximum for all system preparations. 

In attempts to give a dynamical interpretation of the 
second law, it is assumed that a thermodynamic system 
has states distributed in the phase space X. The distri- 
bution of these states is characterized by a (time depen- 
dent) density f(t,x). A thermodynamic equilibrium is 
assumed be characterized by a stationary (time indepen- 
dent) density f*{x). 

The Gibbs' equilibrium entropy definition Eq. 12.11 has 
repeatedly proven to yield correct results when applied to 



a variety of equilibrium situations. This is why it is the 
gold standard for equilibrium computations in statisti- 
cal mechanics and thermodynamics. Thus it makes total 
sense to identify the equilibrium Gibbs' entropy Hc(f^) 
with the equilibrium thermodynamic entropy S TD 

$td = Hc{f*)- 

Do the results in Sections 11111 and II VI on the dynamic 
behavior of the conditional and Gibbs' entropies that we 
have determined analytically, and illustrated with exam- 
ples, offer any insight into dynamic analogs of Sroit) 
andAS(t)? 

The question of how a time dependent non-equilibrium 
entropy should be defined has interested investigators 
for some time, and specifically the question of whether 
the Gibbs' entropy Hc(f) can be taken to coincide with 
the time dependent entropy Std^) of the second law of 
thermodynamics has occupied many researchers. Var- 
ious aspects of this question have been considered in 

i M M E Q El S El Hi El H . 

The non-equilibrium Gibbs' entropy Hq(J) is mani- 
festly not a good candidate for <Std(£) because its dy- 
namical behavior is at odds with what is demanded by 
the Second Law of Thermodynamics. As we have demon- 
strated and summarized, concrete examples can be con- 
structed in which the direction of the temporal change in 
Hc(f) depends on the initial preparation of the system 
and others can be constructed in which Ho(f) oscillates 
in time. Thus there is good reason to search for a differ- 
ent analog of Std (t) ■ 

A number of authors, among them de Groot and Mazur 
Hipp. 122-129, Eq. 2471 van Kampen [H pp. 111-114 
and 185], and Penrose .51, p. 213] have suggested that 
Std (t) should be associated dynamically with 



H NE (f) ee H c (f\Ue H ^) 

= H c {f\U) + H G {U) 



(5.5) 



as an extension of Gibbs [8J, pp. 44-45 and 168] discussion 
of entropy. This also goes under the name of the "Gibbs' 
entropy postulate" pi IBH IH1 IBH IHri W\ . 

Here, we have shown that Hne(/) = H c (f\f„) + 
Ho(f*) has the temporal behavior required for the en- 
tropy SxD(t) of the second law of thermodynamics. This 
is a consequence of the temporal behavior of -ff c (/|/*). 
Namely H^E^f) is either constant for invertible dynam- 
ics, or monotone increasing to the equilibrium value of 
Hc(f*) for non-invertible asymptotically stable dynam- 
ics induced by noise perturbations. Once this identifi- 
cation is granted, then it follows that AS(t) should be 
identified with H c (f\f*): 



AS(t) = H c (f\f. 



as has been previously suggested |43l |5 



f(t, x )\og^-dx, (5.6) 
x f*{x) 
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